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1  Abstract 


This  research  explored  a  variety  of  applications  of  distributed  optimization,  in  which  local 
decisions  are  coordinated  to  produce  a  good  overall  solution.  These  problems  arise  in  many 
areas,  such  as  monitoring  the  health  of  a  complex  system,  coordinating  the  design  of  a  com¬ 
plex  system,  or  fusing  together  information  from  disparate  sources.  The  researchers  exploited 
mathematical  properties  of  the  underlying  problems  to  be  solved  (specihcally,  convexity)  to 
develop  effective  methods. 

Keywords:  Convex  optimization,  distributed  optimization,  power  optimization,  network 
optimization,  fault  estimation,  distributed  design. 


2  Core  research 

The  core  research  conducting  over  the  period  of  this  grant  focussed  on  distributed  and 
networked  optimization  in  a  variety  of  practical  settings,  including  design  (such  as,  for  cir¬ 
cuits)  [5,13,39],  parameter  estimation  and  fault  identihcation  (for  integrated  vehicle  health 
management)  [3,10,12,22],  network  flow  control  [28],  control  of  wireless  and  sensor  networks 
[1,19,26,32,42,44,48,53],  methods  for  general  purpose  control  [2,6,15,27],  and  power  optimiza¬ 
tion  in  processors  [4,35,45]. 

Some  of  these  advances  were  described  in  previous  annual  reports;  here  we  will  describe 
some  others  that  were  not  described  in  those  reports.  In  [17],  Yang  and  Boyd  developed 
a  new  computational  method  for  hnding  bounds  on  performance  for  causal  state  feedback 
stochastic  control  with  linear  dynamics,  arbitrary  noise  distribution,  and  arbitrary  input 
constraint  set.  This  can  be  very  useful  as  a  comparison  to  the  performance  of  subopti- 
mal  control  policies,  which  we  can  evaluate  using  Monte  Carlo  simulation.  Our  method 
involves  solving  a  semidehnite  program  (a  linear  optimization  problem  with  linear  matrix 
inequality  constraints),  a  convex  optimization  problem  which  can  be  efficiently  solved.  Nu¬ 
merical  experiments  show  that  the  lower  bound  obtained  by  our  method  is  often  close  to  the 
performance  achieved  by  several  widely-used  suboptimal  control  policies,  which  shows  that 
both  are  nearly  optimal.  As  a  by-product,  our  performance  bound  yields  approximate  value 
functions  that  can  be  used  as  control  Lyapunov  functions  for  suboptimal  control  policies. 

In  [27],  Yang  and  Boyd  developed  a  new  method  for  fast  computation  of  model  predictive 
control  (MFC)  control  policies.  It  has  been  used  (with  great  success)  for  20  years  in  applica¬ 
tions  with  slow  dynamics,  where  the  sample  time  is  measured  in  seconds  or  minutes.  A  well 
known  technique  for  implementing  fast  MFC  is  to  compute  the  entire  control  law  offline,  in 
which  case  the  online  controller  can  be  implemented  as  a  lookup  table.  This  method  works 
well  for  systems  with  small  state  and  input  dimensions  (say,  no  more  than  5),  and  short  time 
horizons.  In  this  paper  we  describe  a  collection  of  methods  for  improving  the  speed  of  MFC, 
using  online  optimization.  These  custom  methods,  which  exploit  the  particular  structure  of 
the  MFC  problem,  can  compute  the  control  action  on  the  order  of  100  times  faster  than  a 
method  that  uses  a  generic  optimizer.  As  an  example,  our  method  computes  the  control 
actions  for  a  problem  with  12  states,  3  controls,  and  horizon  of  30  time  steps  (which  en¬ 
tails  solving  a  quadratic  program  with  450  variables  and  1284  constraints)  in  around  5msec, 
allowing  MFC  to  be  carried  out  at  200Hz. 
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In  [28],  Trichakis  et  al  consider  a  multi-period  variation  of  the  network  utility  maximiza¬ 
tion  problem  that  includes  delivery  constraints.  We  allow  the  flow  utilities,  link  capacities 
and  routing  matrices  to  vary  over  time,  and  we  introduce  the  concept  of  delivery  contracts, 
which  couple  the  flow  rates  across  time.  We  describe  a  distributed  algorithm,  based  on  dual 
decomposition,  that  solves  this  problem  when  all  data  is  known  ahead  of  time.  We  briefly 
describe  a  heuristic,  based  on  model  predictive  control,  for  approximately  solving  a  variation 
on  the  problem,  in  which  the  data  are  not  known  ahead  of  time. 
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6.  Kwangmoo  Koh,  “Methods  for  Large-Scale  Convex  Optimization  problems  with  li 
Regularization,”  December  2008. 

7.  Argyrios  Zymnis,  “Convex  Relaxation  Methods  for  Fault  Estimation,”  June  2009. 

8.  Jun  Sun,  “The  Map  Stitching  Problem  and  Its  Applications  in  Locally  Isometric  Em¬ 
bedding,”  September  2009. 

5  Software 

All  code  for  papers  with  computational  experiments  posted  on-line.  In  addition,  we  devel¬ 
oped  several  now  packages  in  wide  use. 

1.  CVX  (general  purpose  parser/solver  for  convex  optimization) 

2.  ll_logreg  (G  regularized  logistic  regresssion) 
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3.  ll_ls,  for  large-scale  £i-regularized  least-squares 

4.  ll_tf,  for  li  trend  filtering 

6  Honors 

2008  Best  Paper  Award,  IEEE  International  Conference  on  Communications,  Wireless  Com¬ 
munications  Symposium,  for  “Optimizing  Adaptive  Modulation  in  Wireless  Newtorks 
via  Utility  Maximization,”  by  D.  O’Neill,  A.  Goldsmith,  and  S.  Boyd. 

2006  Honorary  Doetorate,  Royal  Institute  of  Technology  (KTH),  Stockholm. 

2006  Best  Student  Paper  Award,  IEEE  International  Conference  on  Control  Applications, 
for  “Embedded  Estimation  of  Fault  Parameters  in  an  Unmanned  Aerial  Vehicle,”  by 
(student)  S.  Samar,  D.  Gorinevsky,  and  S.  Boyd. 

7  Plenary /Keynote  Talks 

2009  Plenary  lecture.  International  Symposium  on  Advaneed  Control  of  Chemieal  Processes, 
Koc,  Turkey. 

2009  Plenary  lecture.  International  Symposium  on  Mathematical  Programming,  Chicago. 

2009  Plenary  lecture.  International  Conference  on  Optimization  and  Control  with  Applica¬ 
tions,  Harbin. 

2008  Keynote  lecture.  Conference  in  Control,  Communications  and  Signal  Processing,  Uni¬ 
versity  of  Illinois. 

2007  Simon  Stevin  Lecture,  Katholieke  Universiteit  Leuven. 

2007  DYSCO  (Dynamic  systems,  control,  and  optimization)  lecture,  Louvain  la  Neuve. 

2006  Linneaus  Center  Distinguished  Speaker  Series,  KTH,  Stockholm. 


